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Filtering method and an apparatus 



Field of the Invention 

5 

The present Invention relates to a method for filtering comprising 
adaptive filtering an input signal, interpolating the filtered signal, 
interpolating the Input signal for adapting the adaptive filtering, 
providing a reference signal, combining the interpolated filtered signal 

10 and the reference signal for forming an error signal. The invention also 
relates to an apparatus comprising an adaptive filter for filtering an 
input signal, a first interpolator for interpolating the filtered signal, a 
second interpolator for interpolating the input signal, wherein the 
interpolated input signal is arranged to be used to adapt the adaptive 

15 filter. 



Background of the Invention 

20 In prior art there are many different filter designs for different signal 
filtering purposes. The filters can be divided into different categories 
e.g. on the basis of the impulse response of the filters. The filters can 
have either infinite impulse response (IIR) or finite impulse response 
(FIR). The filters can further be categorised into sub categories on the 

25 basis of other properties of the filters. In this patent application the finite 
impulse response filters, or FIR filters, are considered in greater detail. 

The finite impulse response of the FIR filters means that if an impulse 
is input to the FIR filter the output of the FIR filter will stabilize to zero 
30 or to a constant value in course of time. In other words, the effect of the 
input impulse to the output of the FIR filter is finite in time. 

In the following, some terms typical to filters are defined. The filters 
typically have a certain frequency response. This means that different 
35 frequency components of the input signal are attenuated or amplified 
differently, i.e. the frequency properties of the input signal affect on 
how the signal passes through the filter. For example, filters having 
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low-pass frequency response attenuate high frequency signals more 
than low frequency signals. High-pass filters attenuate low frequency 
signals more than high frequency signals. Band pass filters have a 
certain, band pass frequency region on which signals are attenuated 
5 less than signals outside the band pass frequency region. Band stop 
filters have a certain, band stop frequency region on which signals are 
attenuated more than signals outside the band pass frequency region. 
The frequency on which the filtering properties change (e.g. from stop 
band to pass band or vice versa) is called as a cut off frequency. 

10 Typically the cut off frequency is defined as a frequency on which the 
attenuation of the filter is 3 dB above the minimum attenuation (or 
amplification is 3 dB below maximum amplification) of the pass band of 
the filter. In band pass filters there are two cut off frequencies defined, 
wherein the pass band lies between the lower cut off frequency and the 

15 upper cut off frequency. It should be noted here that in practical 
implementations the filtering properties does not change suddenly at 
the cut off frequency but there is always a transition region in which the 
attenuation (or amplification) properties of the filter changes. It is also 
obvious that the frequency response is not necessarily constant on the 

20 pass band or on the stop band but there can exist some variations 
(ripple) as is known by an expert in the field. 

There are many ways to implement apparatuses containing FIR filters. 
In some designs adaptivity has been achieved by using some adaptive 

25 blocks in the filtering apparatus. As an example of such a filtering 
apparatus an adaptive interpolated FIR filter, or AIFIR filter for short, is 
presented in the following. AIFIR filters, which contain one or more 
interpolators, are applicable in such applications in which a large 
adaptive FIR filter is required. For example, in echo cancellation, there 

30 is a necessity to use a large FIR adaptive filter to model the echo path. 
When an AIFIR filter is used in a filtering apparatus, this gives an 
important reduction of the arithmetic operations for both filtering and 
weight updating. The AIFIR filters are well known by an expert in the 
field. It should be noted that the interpolator plays an important role in 

35 the performance of these structures. The existing approaches in the 
field of AIFIR filtering apparatuses does not deal with the design of the 
interpolator. There are many applications, such as system identification 
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and channel equalization, in which prior information about the 
frequency response of the system to be modelled is not available. 
Therefore, in these applications it is not possible to design a fixed 
interpolator. 

5 

The patent US 5,966,415 discloses a digital filter structure comprising 
an equalizer followed by an interpolator. The equalizer works at a lower 
sampling rate while at the output of the interpolator the signal has a 
higher sampling rate. The filter comprises a coefficient register file for 

10 storing different sets of coefficients for the interpolator. Based on the 
data clock and the sampling rate interpolation interval corresponding 
coefficients are taken from the coefficient register file to be used for the 
interpolation. The values of the coefficients stored in the coefficient 
register file are computed in advance by using well known methods 

15 such as the minimum mean square error between the interpolator 
frequency response and the ideal frequency response. Therefore, the 
coefficients are not adaptive but are computed in advance. 

The block diagram of one prior art apparatus including an AIFIR filter is 
20 presented in Fig. 1 , where W(n) represent the sparse FIR adaptive filter 
having (L - 1) zeros between non-zero coefficients. The block denoted 
by / represents the interpolation filter with fixed coefficients which 
recreates the removed samples from W(n), x(n) is the input signal, d(n) 
is the desired signal, z(n) is the output noise and e(n) is the output 
25 error. The filtering structure is composed by a cascade of two FIR 
filters. The goal is to estimate the desired signal d(n) based on the 
input signal x(n). The coefficients of the adaptive sparse filter W(n) are 
adapted such that the expected value of the squared error is 
minimized. In order to handle the sparse nature of the filter W(n) a 
30 constrained approach has to be used. Therefore, the constrained cost 
function to be minimized is the following: 

Minimize £[e 2 (n)], (1) 
Subject to C T W = f (2) 

35 
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Taking into account (1) and (2) the adaptive constrained LMS algorithm 
used for adaptation of the sparse FIR filter W(n) can be described as 
follows: 

5 First, the output of the filter W(n) is computed by: 

y(n)=WW(n) t (3) 

where X(n) = [x(n), x(n-1), x(n - N + 1)f is the vector of the past N 
10 samples from the input signal x(n) and N is the length of the adaptive 
filter W(n). 

Second, the output of the interpolator is computed: 

15 Y,(n; = l l Y(n), (4) 

where I = [i 1t / a i M ] { is the vector containing the interpolator 
coefficients and Y(n) = \y(n), y(n-1), y(n - M + 1)]* is the vector of 
the past M samples from the signal y(n). 

20 

Then, the output error is computed: 

e(n) = d(n) + z(n)- yi (n), (5) 
25 The filtered input vector Xi(n) is computed as follows: 

X/W=%X(«- 7 -) (6) 

When all the above calculations are performed, the sparse adaptive 
30 filter weights can be updated: 



W(* + 1)= F{\V(/z)+ iie{n)X r {n)}+q 



(7) 
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where F=I d -C / (cc / )" 1 C is the projection matrix, l d is the identity 
matrix of the order of N, and q = C* (cc* j^f is a correction vector. 

The matrix C and the vector f from the constrained condition (2) in the 
case of AIFIR are given by (for N odd and L=2): 



C = 



10 0 0 
0 0 10 



0 
0 



f = [o 



0 0 0 0 



(8) 



(9) 



where K 



is the number of zero coefficients in the sparse filter 



W(n) and [*] represents the integer part of the quantity inside the 
brackets. 



15 



Taking into account the equations (8) and (9), the matrix F and the 
vector g in the Equation (7) can be written as follows: 



F = 



1 0 0 0 0 

0 0 0 0 0 

0 0 10 0 

0 0 0 0 0 



20 q = [0 0]J : 



UN 



NxN 



(10) 



(11) 



25 



According to the Equations (10) and (11), it can be seen that the 
Equation (7) is equivalent with the update equation of the standard 
LMS, in which just N - K coefficients are adapted provided that the 
vector W(n) is initialised with zeros. Therefore, the multiplication with F 
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and the addition of q does not introduce extra computations in the 
Equation (7). 

It is also easy to conduct matrices for other values than L=2. For 
example, if L=3 the matrix F has the following contents: 



F = 



1 


0 


0 


0 


0 


; o 


0 


0 


0 


0 


0 


! 0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


1 


0 


0 


0 


0 


0 


0 


0 


0 



The matrix F has non-zero values (=1) only on the main diagonal so 
1 0 that every Lth value of the main diagonal is non-zero. 

It is well known that in the case of an interpolated FIR filter the 
interpolator has to be designed in order to remove the frequency 
images introduced by the zero taps on the sparse filter W(n). In alt prior 
15 art publications known by the applicant of the present invention in the 
field of AIFIR filters the interpolator has fixed coefficients and the filter 
is designed based on some available information about the system to 
be identified, i.e. optimal filter properties. 

20 In order to illustrate how the prior art AIFIR filter approaches work, two 
possible practical example implementations are described. In the first 
implementation the AIFIR filter is used to identify a low-pass filter, and 
in the second implementation the AIFIR filter is used to identify a high- 
pass filter. In both implementations the fixed interpolator has a low- 

25 pass filter frequency response, because it is assumed that the optimum 
filter interpolator is unknown and there is no information available for 
designing the interpolator. Therefore, a low-pass frequency response is 
assumed in these examples. 



30 The frequency response of the optimum filtering apparatus of the first 
implementation is presented in Fig. 2, and the frequency response of 
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the AIFIR filtering apparatus according to the first implementation is 
depicted in Fig. 3. Respectively, the frequency response of the 
optimum filtering apparatus of the second implementation is presented 
in Fig. 4, and the frequency response of the AIFIR filtering apparatus 
5 according to the second implementation is depicted in Fig. 5. Now, 
when the Figs. 2 and 3 are compared, It can be seen that the prior art 
AIFIR filter works quite well, in the case when the frequency response 
of the interpolator is appropriately chosen (for example, a low-pass 
interpolator for a low-pass optimum filter). In the case when the design 
10 of the frequency response of the interpolator does not match the 
frequency response of the optimum filtering apparatus (for example, a 
low-pass interpolator for a high-pass optimum filter) the prior art AIFIR 
filter totally fails as can be seen when comparing the Figs. 4 and 5. 

15 

Summary of the Invention 

The aim of the present invention is to provide an improved method for 
filtering signals, and an apparatus comprising an adaptive filter in which 

20 less computation power is needed compared with prior art filtering 
apparatuses. The invention is based on the idea that at least one 
interpolator of the apparatus is adaptive, wherein the coefficients of the 
interpolator can be changed according to the desired frequency 
characteristics of the apparatus. The adaptation can be performed, for 

25 example, by using the normalized least mean square (NLMS) 
algorithm. To put it more precisely, the method according to the 
present invention is mainly characterized by that the properties of the 
interpolation of the filtered signal are adaptable. The apparatus 
according to the present invention is mainly characterized by that the 

30 apparatus further comprises a first adapting block for adapting the 
properties of the first interpolator. 

Significant advantages are achieved with the present invention. In 
applications where a very large FIR filter is required, the complexity of 
35 the apparatus can be reduced due to the fact that a small number of 
coefficients are different from zero. Therefore, less calculation 
operations are needed than with prior art filtering apparatuses. The 
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invention is also applicable with applications in which there it is not 
possible to have information about the frequency response of an 
optimum filtering apparatus. Therefore, by using the method of the 
present invention the frequency characteristics of the apparatus can be 
adjusted according to the desired frequency response. Also, when 
there is a need to change the frequency response of the apparatus 
during operation it is possible with the apparatus of the present 
invention. The memory space needed to store the filter coefficients is 
also smaller than with prior art FIR filters. 



Description of the Drawings 



In the following, the invention will be described in more detail with 
15 reference to the appended drawings, in which 

Fig. 1 depicts one prior art AIFIR filtering apparatus as a block 
diagram, 

20 Fig. 2 depicts the frequency response of the optimum filter of a 
first example situation, 

Fig. 3 depicts the frequency response of a prior art AIFIR filter for 
the first example situation, 

25 

Fig. 4 depicts the frequency response of the optimum filter of a 
second example situation, 

Fig. 5 depicts the frequency response of a prior art AIFIR filter for 
30 the second example situation, 

Fig. 6 depicts an apparatus according to an advantageous 
embodiment of the present invention as a block diagram, 

35 Fig. 7 depicts the frequency response of the apparatus of Fig. 6 in 
the first example situation, 
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Fig. 8 depicts the frequency response of the apparatus of Fig. 6 in 
the second example situation, and 



Figs. 9a to 9d depict some of main applications classes as 
5 simplified block diagrams. 

Detailed Description of the Invention 

In Fig. 6 there is presented a block diagram of an apparatus 1 

10 according to an advantageous embodiment of the present invention. 
The apparatus 1 includes a signal processing block having an 
adjustable interpolator. The signal processing block is advantageously 
an adaptive FIR filter 2 in which the input signal x(n) is filtered. Hence, 
the apparatus 1 according to this advantageous embodiment of the 

15 present invention can also called as an AIFIR filtering apparatus. It is 
obvious that also other signal processing blocks than FIR filters can be 
used with the present invention. For example, infinite impulse response 
filters (IIR) can be used in some applications. The output signal y(n) of 
the adaptive FIR filter 2 is directed to a first adaptive interpolator 3 and 

20 to a first adapting block 4. The interpolated signal is directed from the 
output of the first adaptive interpolator 3 to the first input 5.1 of a 
combiner 5. The second input 5.2 of the combiner 5 receives a 
reference signal d(n) + z(n), which consists of the desired signal d(n) 
and noise z(n). The combiner 5 subtracts the output signal from the 

25 reference signal of the first adaptive interpolator 3 to form an error 
signal e(n). The error signal e(n) is directed to the first adapting block 4 
and to a second adapting block 6. The first adapting block 4 uses the 
error signal e(n) and the output signal y(n) of the adaptive FIR filter 2 to 
form adapting information for the first adaptive interpolator 3. The first 

30 adapting block 4 uses the adapting information to change the 
properties of the first adaptive interpolator 3 when necessary, for 
example, by changing one or more coefficients of the adaptive 
interpolator 3. The apparatus of Fig. 6 also comprises a second 
adaptive interpolator 7 which receives the input signal x(n) and 

35 interpolates it to form an interpolated input signal x { (n). This is 
necessary in order to have signals with substantially same sample rate 
at both inputs of the second adapting block 6. In addition to the error 
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signal e(n) f the second adapting block 6 also receives the interpolated 
input signal x,(n). The second adapting block 6 uses the received 
signals e(n), x,(n) to change the properties of the adaptive FIR filter 2 
when necessary. 

5 

In the following, the operation of the individual blocks of the apparatus 
1 will be described in more detail. The adaptive FIR filter 2 Is sparse 
FIR adaptive filter having (L - 1) zeros between non-zero coefficients. 
The coefficients of the adaptive FIR filter 2 are preferably adapted such 

10 that the expected value of the squared error is minimized. In order to 
handle the sparse nature of the adaptive FIR filter 2 a constrained 
approach has to be used. The constrained cost function to be 
minimized is the same as with prior art filters. Therefore equations (1) 
and (2) are applicable here. Then, the similar steps than with prior art 

1 5 can be applied as follows: 

First, the output of the adaptive FIR filter 2 is computed by equation (3): 
y(n) = W'(n)X(n). 

20 

Second, the output of the first adaptive interpolator 3 is computed by 
equation (4): 

Y}fn; = l'(n)Y(n), 

25 

but now, the coefficients of the first adaptive interpolator 3 are also 
adapted. The adaptation is performed, for example, by using the 
following equation: 

30 I(n*l)-I(n)+ -B— e(n)Y(n) (8) 
f + Y'(nJY(/j) 

where \i f is the step-size used to adapt the coefficients of the 
interpolator, e{n) is the output error, l(n) = [i(n) 1t i(n) 2 , i(n) M f is the 
A/xl vector containing the coefficients of the interpolator, Y(n) = \y(n), 
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y(n-1), ...,y(n-M + 1)] x is the vector of the past M samples from the 
signal y(n), and s is a small constant. 



The output error e(n) is computed by using the equation (5): 

5 

e(n) = d(n)+z(n)-y,(n). 
The filtered input vector X f (n) is computed by using the equation (6): 

10 Xj{n)=XijX(n-j). 

7=0 

When all the above calculations are performed, the sparse adaptive 
filter weights can be updated by using the equation (7): 

15 W(n + 1) = F{w(ti)+ fie(n)X r (n)} + q . 

The behaviour of the apparatus according to the present invention can 
be analysed e.g. by using the similar example situations than what was 
used above in the description where the background art was 

20 considered. The frequency response of the optimum filtering apparatus 
for the first example is depicted in Fig. 2 and the respective frequency 
response of the apparatus 1 according to the present invention is 
depicted in Fig. 7. The frequency response of the optimum filtering 
apparatus for the second example is depicted in Fig. 4 and the 

25 respective frequency response of the apparatus 1 according to the 
present invention is depicted in Fig. 8. It can be seen by comparing the 
Figs. 2, 3 and 7 that the filtering apparatus 1 according to the present 
inventions works substantially as well as the prior art filtering apparatus 
designed properly according to the requirements of the special 

30 situation. In that case, both the prior art filtering apparatus and the 
filtering apparatus of the present invention approximate very well the 
optimum filter. 

In the case when the interpolator of the prior art filtering apparatus is 
35 not designed appropriately, the prior art filtering apparatus fails to find 
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optimal coefficients for the adaptive FIR filter. The filtering apparatus 1 
according to the present invention has also in this case a very good 
performance. This can be seen by comparing the Figs. 4, 5 and 8. 

5 Although the apparatus of Fig. 6 comprises the first 3 and the second 
adaptive interpolators 7, it is obvious that they can be implemented as 
a single functional unit or a piece of code of a digital signal processor 
(not shown). If, however, there are two adaptive interpolators 3, 7, they 
both can (and should) still use the same coefficients. Therefore, there 
10 is no need to store the coefficients for the adaptive interpolators 3, 7 
twice. This also reduces the memory requirements of the apparatus 1 . 

The first adapting block 4 and the second adapting block 6 can use 
least mean square based (LMS) algorithms in adapting the coefficients 
15 of the interpolators 3, 7, respectively. However, the invention is not 
limited to LMS algorithms but also other suitable algorithms can be 
used in the coefficient adaptation. 

There are many application areas in which the filter according to the 
20 present invention can be applied. Figs. 9a to 9d depict some of the 
main applications classes as simplified block diagrams. Fig 9a depicts 
how the apparatus of the present invention comprising double adaptive 
interpolating FIR filter (DAIFIR) can be used in identification 
applications. The notion of a mathematical model is fundamental to 
25 sciences and engineering. Applications dealing with identification the 
filtering apparatus 1 is used to provide a linear model that represents 
the best fit to an unknown plant The plant 8 and the filtering apparatus 
1 are provided with the same input signal x(n). The plant output 
supplies the desired response d(n) for the filtering apparatus 1. If the 
30 plant is dynamic in nature, the model will be time varying. 

Fig. 9b depicts an inverse modelling application. In this class of 
applications, the function of the adaptive filtering apparatus is to 
provide an inverse model that represents the best fit to an unknown 
35 noisy plant. Ideally, in the case of a linear system, the inverse model 
has a transfer function equal to the reciprocal of the plant's transfer 
function, such that the combination of the two constitutes an ideal 
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transmission medium. A delayed version of the plant input constitutes 
the desired response for the filtering apparatus 1. In some applications 
the plant input can be used without delay as the desired response. 

5 Fig. 9c depicts a predictive application. The function of the adaptive 
filtering apparatus is to provide the best prediction of the present value 
of a certain signal. The present value of the signal thus serves the 
purpose of a desired response for the adaptive filtering apparatus. Past 
values of the signal supply the input applied to the filtering apparatus 1. 
10 Depending on the application of interest, the output y(n) of the filtering 
apparatus or the estimation error e(n) may serve as the system output. 
In the first case, the system operates as a predictor, in the latter case, 
it operates as a prediction-error filter. 

15 The fourth class of applications is interference modelling and it is 
depicted in Fig. 9d as a simplified block diagram. In this class of 
applications, the filtering apparatus 1 is used to cancel unknown 
interference contained in primary signal, with the cancellation being 
optimised in some sense. The primary signal serves as the desired 

20 response for the filtering apparatus 1. A reference signal is employed 
as the input to the adaptive filtering apparatus. The reference signal is 
derived from a sensor or set of sensors located in relation to the 
sensor(s) supplying the primary signal in such a way that the 
information-bearing signal component is weak or essentially 

25 undetectable. 

The above described application classes are known by an expert in the 
field of adaptive filters. The present invention provides improved 
filtering method to be applied e.g. in those application areas. The 
30 improvements are mainly based on the adapting nature of the 
interpolators, which has not been used with prior art filtering methods. 

The above mentioned filtering applications can be utilized, for example, 
in analysing properties of systems such as buildings, earth, human 
35 body, communication channels, etc. For example, in the case of 
analysing buildings the input signal can be a shock wave, wherein the 
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filter coefficients can be used in evaluating the behaviour of the 
building during earthquakes. 

The filtering method of the present invention can also be used for noise 
5 cancellation e.g. to suppress maternal ECG component in fetal ECG. 
The Input signal x(n) of the filtering apparatus 1 is taken near the 
mother's heart to generate as clean heartbeat signal as possible of the 
mother's heartbeats. The desired signal d(n) is taken near the 
abdominal of the mother to get a fetal ECG signal. The "error" signal 
10 e(n) of the filtering apparatus 1 is then the fetal ECG signal from which 
the mother's heartbeat signal is substantially totally removed. 

It is also possible to use the filtering method of the present invention in 
channel equalization, time delay estimation, echo cancellation, 
15 adaptive control etc. It is obvious that the above mentioned 
applications are just non-restrictive examples in which the present 
invention can be applied. 



